Description:

This role requires designing, building, and maintaining robust, scalable data pipelines to support large-scale processing and real-time data needs. As a Senior Developer-Data Engineer, you will optimize data workflows in production environments, implement high-performance data solutions, and optimize complex queries to ensure high efficiency and scalability. The position requires strong planning, organization, and cross-functional communication with multiple audiences, including firm-wide business units and senior leaders.

Key Technologies:

Python, Spark, ETL, Snowflake, GCP, AWS, SQL, PostgreSQL, Oracle, Cosmos DB, Hadoop, Kafka, Java

Requirements:

• A bachelor’s or master’s degree in Computer Science, Engineering, or a related discipline.
• Expert-level proficiency in SQL with extensive hands-on experience working with both relational databases (PostgreSQL, Oracle) and NoSQL systems (Cosmos DB). Strong knowledge of complex query design, optimization, and performance tuning.
• Design, build, and maintain robust, scalable data pipelines using Hadoop, Spark, Snowflake, and Kafka. Optimize production workflows for large-scale processing.
• Strong programming skills in Python and/or Java with solid experience in object-oriented programming. Ability to leverage data processing libraries and integrate with cloud platform APIs.
• Ability to communicate effectively across multiple audiences, including firm-wide business units, senior leaders, associates, and clients. Exceptional interpersonal skills including teamwork, facilitation, and negotiation.

Preferred Qualifications:

• Experience with stream processing and real-time data systems such as Spark Streaming and Kafka Streams.
• Domain experience in financial services or fintech.
• Cloud certifications in AWS, Azure, or Google Cloud Platform (GCP).
• Familiarity with Apache NiFi for data flow automation and management.
• Understanding of DevOps practices, including CI/CD pipelines and automation.